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5 

RELATgO U.g. APPLICAHON 

This patent appljcatiori claims th© benefit of U.S. Provisional AppHcatiori No. 
60/1 76^56, filed on January 15, 2000, enlttted "PRE-PARSING OF VARIABLE 
LENGTH DIGITAL VJDEO (DV) STREAMS*', by Anr>elJa C. Luna, and Jason (Naxfn) 
1 0 Wang. 

■ fifciMiA TBI/ if W 

♦ 

Ihe pi-esent cliscZosure generally relates to iha fictd of di&itai video dflta ptoccQSiBg. Moxe 
p{^ticuk[ly» itkts present dt(^lo8Ut« lelatee to thc> field of decoders for decoding digital video data. 

15 

This disclosure diso^is^cfi the ixnplcxnontation of a DV video decoder with a VLIW processor and a 

» 

vmjablc length decodmg unit, 

REUTED ABX 

Ths advent of fast and powerful etectronrc circufta has enabled the development 
20 of digitat video systems (o^g.., digital camoraa, digital VCR'd, etc.). These digttal video 
systems offer Ngh reaolution and high quality reqorded Images* surpassing the 
resolution and quality provided by analog video systems (e.g,, analog cameras, 
analog VCR's, etc.).. Moreover, the digital video systenns include digital video data as 
well as digilal audio data, raising the entortalnment e^rfencs of ^e user. Since 
25 digital video systenns manipulate dlgftol data, tho original recorded Images stored in 
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4 

the digital format of digital video systoms do not suffer tho deleriomtion in quality 
observed with the original recorded images stored in the analog format of analog 
video systems. 

■ « 

5 Some digital video systems have been integrated into a computer system, 

« 

allowing a user to edit and to view digUal video data and digital audio data.. Other 
digital video systems have been designed to communicate and to transfer digital data 
(e g., d'lgHal video data and d}0tQ} audio data) to a computer system, permitting the 
user to exchange or to view the digital data. 

10 

A popular digital video system stores digital video data which is fomrtatted as 

a 

specified In a specification entitled, "The Specification of Consumer Use Digital VCR's 
using 6.3mm Magnetic Tape", (HD Video Conference, Deoembor, 1 99^). This j 
spocHication is commonly known as the DV standard. The DV standard is a 
15 compressed digital video data and drgttal audio data record}ng standard. A DV digital 

i 

video system uses a 1/4 inch (6 .35mni) metal evaporate tape to record very high j 
quality digital video data. Alternatively, a DV digital video system can record by ; 
transmitting to a memory device (a g., hard drive, BAM, ROM, etc.) very high quality 
digital video data and digital audio data for storing therein. Both consumers and 

* 

20 professionals use DV digital video systems. 

« 
< 

t 

To play the digital video data which Is f onmatted according to the DV standard, j 

■ 

the DV digital video system includes a DV video decoder for processing the digital | 

■ 

t 

* 

■ 

• 
; 
I 

> 

> 
\ 

* 
■ 
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video data Into a format which can be displayed on an electronic display device. 
Since the DV video decoder processes the digital video data in real-time, speed and 
parformance are crucial charactenetice of the DV decoder. Generally, speed and 
performance are achieved at great cost. Hardware and software specifically designed 
5 for the DV video decoder can price the DV digital video system out of reach of the 
average consumer. Typicaily. off-the-shelve hardware and software adapted for the 
DV video decoder does not provide the speed and performance necessary for a DV 
digital video system. Some equipment manufactures have designed general^purposQ 
components to provide a software solution for manufacturing low cost consumer digital 
10 video decoders. 
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SUMMARY PF im tNYENTlPM 

A decoder for decoding a plurality of digital vidoo data \& described. In an 

embodiment, the decoder oomprisee a DV video decoder for decoding digital video 
data which is formatted aooording to the DV standard. The DV video decoder hae a 
5 Very-Long Instruction Word (VLIW) processor and a variable length decoding unit.. 
The VLIW processor includes a preparser unit for recovering a decoding order of the 
digital video data so that the variable length decoding unit can process the digital 
video data. The variable length decoding unit decodes a varfable length coding 
format of the digital video data which has been preparsed by the VLIW processor. 
10 Furthernnore^ the VUW processor includes a decompression unit for decompressing 
the digital video data which has been decoded by the variable length decoding unit 
In an embodiment the VUW processor and the varfable length decoding unit and 
formed on the same semiconductor device. 

1 5 The decoder of the present invention primaiily utilizes software to process the 

digital video data. Because the decoder is impfemented In software, the decoder can 
be adapted to process different types of data formats simply by modifying the software 
rather than designing a new decoder. 

■ 

20 The digital vidoo data has an arrangement specified by the DV standard. In this 

arrangement, the digital video data Is grouped fnto a plurality of Discrete Cosine 
Transform (DOT) blocks of fixed length representing com|>ressed and vadablo length 

■ 

coded digital video data for a fixed number of pixels* During the DV recording 

I 
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process^ the fixed number of pixels may generate more digital video data than can be 
stored within the fixed length of a particular OCT block.. Since each DCT block hae a 
fixed length, some ot tho digital video data belonging to the particular DCT block ia 
distributed to on© or more additional DCT blocks having unused ©pace within their 
6 fixed lengths. 

The VLIW processor preparses tho drgital video data so that the digital video 
data Is re-asGoclated with the corresponding DOT block. After the VLiyV processor has 
prepared the digital vkleo data, the digital video data is contiguous within the 

10 corresponding DOT bk)clc Thus, the DOT blocks are transfomned from fixed length to 
variable length to accommodate all the digital video data belonging to each DOT' 
block, in addition, the re-ordering of the digital video data within the OCT bkx:K 
structure enables the variable length decoding unit to decode a variable length coding 
fomnat of the digital video data. According to the present invention* the logically 

1 5 complicated process of preparsing the digital video data is executed by the VLIW 

processor while the varfablo length decoding unit focuses on decocfing variable length 
symbols of the digital video data. Since the variable length decoding unit is designed 
to perform variable length deooding> the variable length decoding unit usually does 
not have enough processing iogio (e.g., ofrcuitry or software code) to collect the extra 

20 bits of a parttoular DCT block that are stored in other DCT blocks' unused space. 

Moreover^ a first plurality of digital video data can be preparsed by the VLIW 
processor while the variable lengHi decoder unit decodes a second plurality of digital 

-6- 
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Video Giala which has been preparsed. Addrtfonally, the second plurality of digital 
video data which has been preparsed can be decoded by the variable length decoder 
unit while the VLIW processor decompresses a third plurality of digital video data 
which has bean decoded. Smce the DV decoder of the present invention concun'ently 
5 executes multiple operations on the digital video data, the DV decoder of the present 
Invention features superior speed and performance characteristics while containing 
costs. 



These and other advantages of the present invention will no doubt become 
10 apparent to those of ordinary skill in the art after ha>4ng read the following detailed 
description of the preferred embodiments which are illustrated in the drawing figures. 



In one embodiment the present invention includes a method of processing 
digital video data for displayingp the method comprising the steps of: a) prepsrsing the 
1 5 digital video data to recover a decoding order of the digital video data; b) decoding a 
variable length coding format of the digital video data; c) moving the digital video data 
that has been processed by the step b); and d) decompressing the digital video data to 
fadlitate displaying the distal video data on art electronic display device. 



20 In another embodiment, the present irtvention includes an apparatus for 

processing digital video data for displaying, the apparatus comprising: a processor 
configured to preparse the digital video data to iBCover a decoding order of the digital 
video data; and a variable length decoding unit coupled to the processor, wherein the 
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variabf© length decoding unfl is configured to decode a variable length coding fonmat 
of the digital video data. 



-7- 
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BBlEEJOeSGBlEIlQtiQF TH^ PRAWINgS 



The accompanying drawings, which ara incorporated In and form a part of this 

Specification, illustrate embodiments of the invention and, together with ih© 

dGScriptfoHr serve to explain the principles of the present Invention. 



Figure 1 A Illustrates a digital video system in which embodiments of the present 
Invention ceuti be practiccKt. 

Rgure 1B Illustrates encoding steps for the digital video data on which 
10 embodiments of the present InverYtlon can be practiced.. 

Figure 2 iliustrates a frame of digital video data on whfch embodiments of the 
present Invention can be practiced.. 

15 RgurB 3 Illustrates a segment of digital video data on which embodiments of the 

present invention can be practiced. 

Figure 4 illustrates a macro block of digital video data on which embodiments of 
the present invention can be practiced. 



Figu/B 5 illustrates a DOT block of digital video data on which embodiments of the 
present invention can be practiced. 



5 



20 
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Figure 6 Hlustrates a decoder, showing a VUW processor and a variabie length 
decoder unit in accordance with an emboditnent of the preeent invention. 

Rguro 7 Illustrates operations executed on digital vJdeo data by the decoder of 
5 Rgure 6 in accordance with an ennbodlment of the present invention. 

Figure 8 (llustrales a recovered data buffer foi accordance wl^ an amt>odimertt of 
the present invention . 

1 0 Figure 9 illuetratos a decoded data buffer in accordance with an embodiment of 

the present Invention, 

The drawings referred to in this description should not be understood as being 
drawn to scale except if specifically noted. 
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DET AILED DES CRIPTION OF THE IN.V.&NT1-QM 

Reference will now be made in detail to the prefenred embodinionts of the 
present inventionr ejcamples of which are Itlustreted in the accompanying drawings- 
While ihe Invention wi'JI b© described in conjunction with the preferred embodiments, It 
5 will be understood that thoy are not intended to limit the Invention to these 
embodiments. On the contrary, the jnvgntion is intended to cover alternatives, 

« 

modifications and equfvatents, which may be included vMiln the spirit and scope of 
the inventton as defined by the appended claims^ Furthermore, In the following 
detailed description of the present Invention, numerous specific details are set forth in 
10 order to provide a thorough understanding of the present invention.. However, It wlU be 
recognized l>y one of ordinary skill in the art that the present invanticm may be 
pracifced without these specific details. In othier instances^ woJt known methods, 
procedures^ components, and circuits have not been described in deiail as not to 
unnecessarily obscure aspects of the present invention. 

15 

MQTATIQN AMD NOMENCLATUBE 

Some portions of the detailed descriptions which foltow are presented In terms 
of procedures, logic blocks, processing, and other symbolic representations of 
operations on data bits within a computer memory. These descriptions and 
20 representations are the means used by those skilJed in the data processing arts to 
rnost effectively convey the sut>stance of their work to others skilled in the art. In the 
present application, a procedure, logic block, process, etc., is conceived to be a seff- 
consistent sequence of steps or instructions leading to a desired result. The steps are 

.10- 



PAGE 6IV93 ' RCVD AT 12121/2006 3:42:17 AM [Eastern Standard rone] ' SVR:USPT0-EFXRF-3ft ' DNI8:2738300 ' CSID:7039974517 ' DURATION (inm-ss):35-54 



To: USPTO Page 61 of 93 



2006-12-21 08:42:07 (GMT) 



7039974517 From: Winston Hsu 



WO 02/37829 PCT/US61/50130 

those requiring physical manipulations of physical quantities. Usually, though not 
necosGarily, thase quantltiQB taka tha form of eloctrfcQl or magnetic eignala capable of 
being stored, transfenred, combined, compared, and otherwise manipulated in a 
computer system, ft has proved conveniant at times, princfpal/y for reasons of common 
5 usage, to refer to these signals as bits, values, elements, symbols, characters, terms, 
numbers; or the like. 

It should be borne In mind, however, that all of these and similar terms are to be 
associated with the appropriate physical quantities and are merely convenient Vabels 

1 0 applied to these quanthfes. Unless specincally stated othemvise as apparent from the 
following discussions, It Is appreciated that throughout the present invention, 
discussions utilizing terms such as "proparsing", "decoding", **decomprssalng*, *'de- 
shuffHng" or the like, rofer to the actions and processes of an electronic system or a 
computer system. The computer system or similar electronic computing device 

1 5 manipulates and tmnsfoims data represented as physical (electronic) quantities within 
the computer system's registers and memories into other data similariy repiBsented as 
physical quantfties within the computer system memories or registens or other 
inforrnation storage, transmission, or display devices. 

20 DV VIDEO DECODER 

Rgun3 1 A illustrates a digital video system 50 in which embodiments of the 
present invention can be practiced. Although the description will focus on digital video 
data which Is fbnmatled as specified In a spedfication entftied, "The Speclftoatlon of 

-11- 
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Consumer Use Digital VCR's using 6.3mm Magnetic Tape", (HD Video Conference, 
December, 1984). commoniy known as the DV standard, it should be understood that 
the present Invention Is applicable to digital video data which is formatted in 
accordance wUh other standards, such as siandaitis developed by the Moving Picture 
5 Experts Group (MPEG) (e.g., MPEG-1 , MPEG-2, MPEQ-8, etc.). 

In an embodiment, a DV data source 80 is coupled to the digital video system 
50 via a data bus 65.. Tho DV data source 80 stores the recorded DV data, Ihe DV 
data source 80 can be a DV tape, a DV disk* a memory devicb (e.9., hard drive, RAM, 

10 ROMf etc.)» or any other storage device whidi is capable of storing DV data.. In an 
embodiment, the data bus 85 comprises a IEEE 1394 serial data bus 85 which Is a 
low-cost and high-performance digitai bl-directionat serial bus. Alternatively* the data 
bus 85 can be implemented as any other type of data bus. The DV deta is organized 
Into the digital interface format (DIF) for digital transmission via the IEEE serial data 

15 bus 65. 

In an Gmt>odiment, the digital video system 60 comprises a DIF parser 90 
coupled to the data bus 85, a digital video data decoder 100 coupled to tho DIF parser 
90, and a digital audio data decoder 110 coupled to the DIF parser 90. The DIF parser 
20 90 receives the DV data from the DV data source 80 via the data bus 85. The DIF 
parser 90 separates the DV data Into a plurality of data streams* The data streams 
include a first data stream of digital video data which is formatted according to the DV 
standard and a second stream of digital audio data which is formatted according to tho 



-12- 
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DV standard, it should be understood that th6 DV data can Include other data, such as 
subcode* auxiliary video data» or auxiliary audio data. It should be understood that the 
OIF parser 90 can separate the DV data into other data streams, such as a data stream 
for subcode data (e.g., error correction data, timecodo data, etc-)- 

5 

In an embodiment, the digital video data decoder 100 receives the stream of 
dgitai video data, wliich is formatted according to the DV standard, from the DIP parser 
90 via the data path 93. Similarly, the digital audio data decoder 110 receivGe t^te 
etream of digital audio data, which Is formatted according to the DV standard, from the 
1 0 DIF parser 00 via the data path 96. 

In an embodiment, the digital video data decoder 1 00 comprises a D V video 
decoder 100. The DV video decoder 100 decodes the digital video data into a format 
for displaying the recorded Images on eui electronic display device 120 coupled to the 

1 5 digital video system 50. From the OV video decoder 100, the digital video data is 
moved to the electronic display device 120 via a data path 105. The operation of the 
DV video decoder 100 will be described below. The stream of digital video data 
received by the DV video decoder 100 arrives In a compressed and variable iength 
coded format compliant with the DV standard. As will be discussed below, the DV 

20 video decoder 100 decodes the variable length code format of the digital video data 
and decompresses the digital video data. 



-13- 
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The digital aucfio decoder 110 comprises a DV audio decoder 110. The DV 
audio decoder 110 decodes the digital audio data into a format for rendering on a 
30und device 130 coupled to the digHaf video syet^i 50 (e.g-, a DV system ). From 
the DV audio decoder 110, the digital audio data Is moved to the sound device 130 via 
5 a data path 11&. The sound device 130 can be implemented in any manner. For 
oxampio, the sound device 130 can include a sound ampHfier and a speaker. 

It should be understood that the digital video system 60 (e.g.. a DV system) of 
Figure 1 A can be configured in any other manner. 

10 

Rgure IB Illustrates anooding steps for the digital video data on which 
embodiments of the present invenUon can be practicdd Afthough the discussion will 
focus on the DV standard, \i should be understood that the present invention can bo 
practiced with digital video data which fs formatted according to other standards {e .g»i 
1 5 MPEG »1 » MPEG-2, fv1PEQ-<3, eto.) . 

Before beginning the process of encoding digital video data Into the DV format, 

« 

analog video data is converted into digital video data comprising data in the Y,Cr»Gb 
color space, whereas Y refers to luminance data while Cr and Cb refer to chrommance 
20 data* If ths analog video data is sampled according to the Phase Alternation Line (PAL) 
or (625/60) TV standard, the digital video data comprises data In the Y,Cr,Cb 4:2:0 color 
space. If the analog video data is sampled according to the National Television System 

.14. 
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Committee (NTSC) or (525/60) TV standard, the digital video data comprises data In the 
Y,Cr,Cb 4:1 ;1 color ©pace.. 

■ 

In an embodiment of the encoding procedure, a stream of digital video data te g 
6 data In the Y,Cr,Cb color space) first proceeds to the shuffling process 210. More, the 
digital video data is divided into a plurality of macro blocks. Ihe macro blocks are 
shufflad, or moved around. The shuffling step minimizes the effect of contiguous errors 
on the appearance of a frame of digital video data. Additionally, shuffling step aids in 
error correction, makes error concealment more effective* and evens out the distribution 
10 of digital video data In a frarne so that there is an even flow of digital video data through 
the rest of the encodrig steps. 

The stream of digital video data proceeds to the DCT process 220 Hero, the 
digital video data Is compressed using the Discrete Cosine Transform (DCT). Ir^ 

15 particular, digital video data Is divided Into a plurality of DCT blocks comprising the digital 
video data of 8 x 6 pixels and then the OCT blocks are compressed using OCT. In the 
B-d-CX^T mode, the digital video data of 8 x 6 pixels are compressed as a block. In the 
4-8-DCT mode, the digital video data of 6 x 8 pixels are delr^eriaced into two 
independent blocks comprising the digital video data of 4 x 8 pixels.. Moreover, each 

20 block of digital video data of 4 x 8 pixels is compressed using DCT. The DCT process 
220 generates DC coefficients and AC coefficients which are stored fn each DCT block of 
digital video data. 

-IS- 
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Tlie Stream of digitai video data proceeds to the quantization process 230.. Here, 
the digital video data (e.g.. DC coefficients and AC coefficients) compressed by the DCT 
process 220 is further compressed by being mapped to quantization intervals. 



5 The stream of digital video data proceeds to the variable length coding process 

240.. Here, the AC coefficients of the digital video data are encoded by a variable length 
coding algorithm- In an embodiment, the variable length coding algorithm comprisoe a 
Huffman code format. According to the Huffman code fcmiat, a variabJ© length coding 
table aaslgna variable length codee or symbols to AG coefficient of the digital video data, 
1 0 whereas the variable length aymbole are shorter for more common AC coefficients and 
are longer for less corrumon AC coefficients. 



It should be understood that hardware or software can be used In Implementing 
the shuffling process 21 0, the DCl process 220, the quantization process, and the 

* 

15 variable length coding process 240.. Moreover, the digital video data can be encoded 
into the DV standard using other processes. 



After performing the encoding steps of Rguro IB on the digital video data, the 
digital video data is stored in a DV tape, a DV disk, a memory device (e-g., hard drive* 
20 RAM, ROM, etc.), or any other storage device which Is capable of storing DV data. The 
digital video data {whfch Is now ccmpfsssed and variable length coded) }s storod in the 
anangement illustrated In Rgures 2-5. 



-is- 
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Rgure 2 illustrates a frame 250 of digital video data (oonnpressed and variable 
length coded as illustrated in Figure IB) on which embodiments of the present 
invention c^an be practiced. The digital video data encoded into the DV standard is 
divided into a plurality of frames. Each frame 250 Includes a plurality of segments 
5 251- 257 of digital video data. Ae illustrated (n Figure 2, the frame 250 includes 270 
separate segments. It should be understood that the number of segments depends on 
the TV standard used in eampling the analog video data as discussed above.. The 
NTSC IV standard generally requires 270 segments per frame of digltai video data. 

1 0 Rgure 3 illuetrates a segment 350 of digital video data (compressed and 

variable length coded as illustrated in Figure IB) on which embodiments of the 
present invention can be practiced. Tfie segment 3S0 includes a plurality of macro 
bloclcs 351*355 of digital video data. Here, the segment 350 has five macro blocks of 
digital video data, it should be understood tiiat each segment of Rgure 2 vs arranged 

15 as illustrated in Rgure 3. 

Figure 4 illustrates a macro block 450 of digital video data (compressed and 
variable length coded as illustrated in Figure IB) on whtoh embodimente of the present 
invention can be practiced. The macro block 450 indudes a Macro Bk>ck (MB) header 
20 451 A, and a plurality of OCT blocks 451-456. in an embodiment, the MB header 451 A 
includes four bits for STA (status of the compressed macro block) and four bits for the 
QNO (quantization number applied to the macro bioclc). Here» the macro block 450 
includes six OCT blocks of digital vkleo data. DOT bk>cks 451-454 include digital video 

-17- 
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data corresponding to luminanco data of the rocordod images. DCT blocks 45&-456 
inctuds digrtal video data correspondrng to chnomfnanca data of the recorded Images. It 
should be understood that each macro block of Figure 3 is ananged as iiruatrated in 
Figure 4. 

5 

Figure 5 illustrates a DCT block 550 of digital video dara (compressed and 
variable length coded as illustrated in Figure IB) on which embodimentd of the present 
invention can be practiced. The DCT block 550 includes a plurality of digita) video data. 
In an embodiment, the DCT block 550 includes a motion bit 667A which indk^ates 

10 whethei to perfomi 6-8 IDCT or 2-4-8 tDCT» a class number 557B which is used for 
quantization, a plura% of DC coefficients 551 which are compressed as described in 
connection with Figure 1B» a plurality of AG coefficients 552 which are compressed and 
variable length coded as described in connection with Figure 16, and an unused 
space/overflow AC coofficJents 554» The DCT block 550 can include an end-of-block 

1 5 code (EOB) 553, which Is variable length coded, to Indicate the end of the AC coeff ic'ients 
corresponding to the DOT block. The OCT computation discussed In connectton with 
Figure 1 B generates the DC coefficients and the AC coefficients for each DCT block of 
digital video data of 8 x 6 pixels.. In an embodiment, the DC coefficients 551 area has a 
total length of nine bits, the motion bit 557A has a length of one bit, and the class ruimber 

20 557B has a length of two t^ts. It should be understood that each DCT bkx:k of Figure 4 is 
arranged as illustrated In Figure 5. 



-is- 
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Moroover, each OCT block llluatated in Figures 4-5 is allocated a fixed length of 
bits or bytes of digital video data as required by the DV standard. The number of bits or 
bytes reqMfred to store the AC coefficients of the digital video data of 8 x 8 pixels may 
vary widely in accordance with the quantization process 230 described with respect to 
5 Rgur© IB. A particular OCT block may have unused space 5S4 within its fixed length 
allocation of bits or bytes while another DOT btock may not have sufficient space within 
its fixed length allocation of bits or bytes for the AC coefficients of the digltai video data of 
8 X 8 pixels, thus generat/ng overflow AC coefficients. The overflow AC coeific'tents are 
distributed to OCT blocks (within the same macro block) leaving unused space 554.. The 
1 0 remaining overflow AC coefficients are distributed to OCT bk)cks (wtthln the same 

segment) having unused space 554. Thus, unused space 554 fn a OCT block may be 
used to store overflow AC coeffrcfents belonging to other OCT blocks within Iho same 
macro block, or oven within the same segment. 

15 it should be understood that the frame 250, the segment 350» the macro bk)ck 

450, and the OCT block 550 iflustrated in Figures 2-5 can have additional types of 
data. Moreover, it should be understood that the d^ital vkieo data can be arranged In 
a manner other than that described with respect to Figures 2-5.. 

20 Figure 6 illustrates a video decoder 100 of Figure 1 A» showing a VLIW 

processor 610 and a variable length decoder unit 620 in accordance with an 
embodiment of the present Invention . Although the stream of digital video data 
decoded by the video decoder 100 is formatted accc^ng to the DV standard, it should 



PA6E 69/93 ' RCVD AT 12(21/2006 3:42:17 AM lEaslem Standard rune] ' SVR:U8PTO-EFXRF-3/1 ' DNIS:2738300 ' CSID:7039974517 ' DURATION (inn)-ss):35-54 



To: USPTO Page 70 of 93 2006-12-21 08:42:07 (GMT) 7039974517 From: Winston Hsu 



WO PCTA;S0.1/50130 

be understood that the video decoder 100 of tho prosont invention can decode dighel 
video data formatted according to other standards (o„g., MPEG-I, MPEG-2, MPEG-3, 
etc.). 

5 The video decoder lOD of the present inventfon primarily utiJhzee software to 

process the digital video data.. Because the video decoder is implemented in software* 
the video decoder can be adapted to process different types of data formate simpiy by 
modifying the software rather then designing a new video decoder 

10 In an embodiment, the video decoder 1 00 (e-g., a DV video decoder) includes a 

digital video data buffer 660, a Very-Long instruction Word (VL.IW) processor 610 
coupled to the digital video data buffer via a data path 665, a variable length decoder 
unit 620 coupled to the VLIW processor 610, and a frame buffer 670 coupfod to the 
VLIW processor 610 via a data path 675.. In an emfc>odimont, the VLIW processor 610 

15 and the variable length deo^der unit 620 are fonned on the same semiconductor 
device such that the VLIW processor 610 functions as the main or core processor 
while the variatHe length decoder unit 620 functions as a coprocessor Since the 
digital video data is fbrmatted according to the DV standard, the video decoder 100 
will be referred to as the OV video decoder 100, T he OV video decoder 100 executes 

20 on tfie digital video data (compressed and variable length coded) the inverse of the 
encoding steps discussed with respect to Figure 1 B In order to display the digital video 
data on an electronic display device 120 (Figure 1 A). In particular, the DV video 
decoder 100 decodes the variable length symbols of the digital video data, 

-20- 
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decompresses the digital video data by performing an Invert© quantization process^ 
decompresees the digital video data by performing an inverse discrete cosine 
transform {\OCT) process, and de-shuffles the cflgi'tal video data. 

5 In Figufe 6. some of the data paths may be logical rather than physical (e.g., a 

data bus), fn addition, some of the data paths may share one or more data buses- 

The processing of the digital video data (compressed and vaHabJe ler^gth coded 
as illustrated in Figure IB) is executed on the VLJW processor 610 and on the variable 

10 length decoder unit 620.. T)ie VUW processor 610 preparses the digital video data to 
recover a decoding order of the digital video data by re-assooiatlng the overflow AC 
coefficients (compressed and variable tength coded) of the dgitai iddeo data with the 
corresponding DCT block, generating digital video data that is contiguous within the 
corresponding DOT block. In particular, a preparser unit 640 of the VLtW processor 

IS 610 preparses the digital video data. The OCT Nocks are transformed from fixed 

length to vanable length to accommodate afl the digitaf video data belonging to each 
DOT block. Once the digital video data fs arranged In the decoding orders thd variable 
length coding format of the digital video data which lias been preparsed can be 
decoded by the variable length decoder unit 620. Furthennore, ttie VLIW processor 

20 610 decompresses the digital vkieo data which has been decoded and de-shuffles the 
digital vkfeo data which has been decompressed. In particular, a decompressloii unit 
630 of the VLIW processor 610 decompresses and de-shuffles the digital video data. 

-21- 
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The DV video decoder 100 of the present invention has superior speed and 
perfotmancs characteristfcs because the VLIW processor 610 preparses the digital 
video data prior to the variable length decoder unit 620 decoding the digital vid6K> 
data. The VLIW procBssor 610 breaks program Instructions down into basic 
5 operations that can be performed in parallel. Complexity Is moved from the hardware 
of the VUW processor 610 to software executed by the VLiW processor 610. The 
variable length decoder unit 620 can decode variable length eymbds much ^ster than 
the VLIW processor 610. However, It is very dOficiM to use the variable length decoder 
unit 620 to preparse the cfigltal video data to recover the decoding order of the digital 
10 video data so that the digital video data is contiguous within the corresponding OCT 
block since the variable length decoder unit 620 lacks the general functionality of a 
general purpose processor or the VLIW processor* 610. 

According to the present Invention, the iogically complicated process of 
15 prsparsing the digital video data Is executed by the VLIW proceseor 610, leaving the 
varfs^le length decodsr unri 620 responsible for decoding the vatfable length symbols 
of the digital video data which has been proparsod. Moreover the VLIW processor 
610/variabte length decoder unit 620 architecture facilitates concurrent execution of 
multiple processes to imprcvo performance of the DV video decoder 100. A first 
20 plurality of digital video data is preparsed by the preparser unit 640 while a second 
plurality of digital video data which has been preparsed fs decoded by the variable 
length decoder unit 620. Moreover, a third plurality of digital video data which has 
been decoded Is decompressed and de-shuffled while the second plurality of digital 

-22- 
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vIdcK) data which has been prepar^nid is decoded by the variable tength decoder unit 
620. 

Referring to Figure 6, a stream of digital video data is roceived by the digital 
5 video data buffer 660. Digital video data is transferred to the preparser unit 640 via the 
data pa^ 665. After Ihe preparser unit 640 processes the digital video data, the digital 

# 
% 

video data proceeds to the variable length decoder unit 620. From the variable length 
decoder unit 620» the digital video data proceeds to the decompression unit 630. 
Rnally, the digital video data is transferred via the data path 675 from the 

1 0 decompression unit 630 to the frame buffer 670 from which the digital video data can 
be readily displayed on an electronic display device 120 (Figure 1 A). In an 
embodiment, the digital video data buffer 660 and the VUW processor 610 are formed 
on separate semiconductor devices. The digital video data buffer 660 can be 
implemented as synchronous dyruimto random access memory (SDRAM) or any other 

15 type of memoiy.. In an embodiment, the frame buffer 670 and the VLIW processor 610 
are formed on separate semiconductor devices. 

■ 

In an embodiment the VLIW processor 610 comprises a model MAP100QA 
mecHa accelerated processor manufactured by Equator Techniologies, inc. of Seattle, 
20 WA (www.equator.com). The preparser unit 640 and the decompression unit 630 are 
implemented on the VLIW processor 610 or coro processor of the MAP1000A. The 
variable length decoder unit 620 is implemented on the coprocessor (which includes a 
variable length encoder/decoder) of the MAP1000A. It should be understood the DV 

-23- 
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vidQO decoder 100 can be implemsnted with othor VLIW processors or general 
purpose processors. 

Figure 7 illustrates operations executed on digital video data by the DV video 
5 decoder 100 of Figure 6 in accordance with an embodiment of the present invention. 
A data streamer 705 of the VLIW processor 610 is coupled to the digital video data 
buffer 660 and to a data segment buffer 710. In an embodiment, the data streamer 
705 comprises a programmable direct memory access (DMA) unit,. The data streanier 
705 moves the digital video data to the prcpanser unit 640. In particuiar. the data 

10 streamer 705 moves the digital video data to tfte data segment buffer 710. In an 
embodiment, the data streamer 705 moves a segment of digital video data or five 
macro blocks of digital video data or 30 OCT' blocks of digital video data to the data 
segment bxrifei 71 0 . It should bo understood that the amount of digital video data 
transferred to the data segment buffer 710 depends on the size of the d£ita segment 

1 & buffer 710. In an embodiment, the data segment buffer 710 comprises static random 
access memory (SRAM). 

The data segment buffer 710 is coupled to a de-f naming pass 1 unit 720 of the 
VLIW processor 610. The de-framing pass 1 unit 720 of the VLIW processor 610 
20 executes software instructions whteh determine those OCT blocks In whbh all the AC 
coeffidents {compressed and variable length coded) are stored within the 
corresponding DOT blocke. An EOB 653 {Figure 5), which is variable length coded, 
found before the end of the fixed length of the IX^T block Indicates that the OCT block 
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Stores all of fts DC coefficients (compressed) and AC coefTicrents (compressed and 
variable length coded)., in an embodiment, 30 OCT blocks of digital video data are 
processed in parallel by the de-framIng pass 1 unit 720 of the VLIW processor 610. It 
should be understood thai the number of DCT biocks/which can be processed in 
5 parallel depends on the processing speed of the preparser unit 640 and the resources 
allocated by the VLIW processor 610. The de-framing pass 1 unit 720 of the VUW 
processor 610 ra coupled to a recovered buffer 7S0 and a data overflow buffer 730- 

T>)e DCT blocks of digital video data havirig overflow AC coefficients 
1 0 (compressed and variable length coded) are moved from the de-framing pasis 1 unit 
720 to the data overflow buffer 730 while ttie rest of the POT blocks are moved from 
the de-framing pass 1 unit 720 to the recovered buffer 750. The data overflow buffer 
730 is coupled to a de-framIng pass 2 & 3 unit 740 of the VLIW processor 61 0, From 
the data overflow buffer 730, the DCT blocks of digital video data having ovedlow AC 
15 coefficients (compressed and variable length coded) are moved to a de-framIng pass 
a & 3 unit 740 of the VUW processcMT 61 0. The de-framIng pass 2 & 3 unit 740 of the 
VLIW processor 61 0 executes software Instructions which re-associate the overflow 

■ 

AC coefficients (compressed and variable length coded) belonging to DCl' blocks 
within the same macro block. Moreover, the de-framIng pass 2 & 3 unit 740 of the 
20 VLIW processor 61 0 executes software inetructions which re*assoclate the overflow 
AC coefficients (compressed and variable length coded) bebngtng to DCT blocks 
within the same segment. The de-framing pass 2 & 3 unit 740 of the VUW processor 
610 Is coupled to the recovered data buffer 750. From the de-framfng pase 2 & 3 unit 

-2S- 
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740 Qf the VUW processor 61 0» the DCT blocks are moved to the recovered data 
buffer 750 . 

After proceasing by the de-framing pass 1 urut 720 of the VL.IW processor 610 
5 and the de-framing pase 2 & 3 unit 740 of the VLIW processor 610, the preparser unit 
640 has recovered a decoding order of the digital video data so that the variable 
length decoder unit 620 can decode the digital video data. The recovered data buffer 
750 stores dIgrtaJ video data that Is contiguous within the corresponding DCT block. 
The overflow AC coefficients (compressed and variable lengU) coded) are now 

1 0 associated with the corresponding DOT block. The OCT blocks have variable lengths 
to'accommodate all the overflow AC coefficients (compressed and variable length 
coded) belonging to the con«sponding DCT block. Additionally, each DCT block 
includes an EOB symbol to indicate the end of the DC coefficients (compressed) and 
the AC coefficients (compressed and variable length coded) of the DCT block. If there 

15 is no EOB aymbol within a DCT block in the input stream of digital video data received 
from the digital video data buffer 660, the de-framing pass 2 & 3 unit 740 inserts an 
EOB symbol within the end of that DCT block. Therefore, the variable length decoding 
unit 620 can determine the end of each DCT block by looking for the EOB symbol. 
Moreover, the variable length decoder unit 620 can now proceed to decode the 

20 variable length code fomnat of the DCT blocks of digital vkJeo data. As discussed 
above, ft Is very difficult to utilize the variable length decoder unit 620 to propBt&B the 
digital video data.. In an embodiment, the variable length code fonmat compf tses a 
Huffman code format. 

-2S- 
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The data stmamer 705 transfers the digital video data from the recovered data 

* 

buffer 750 to a get bit unit 755 of the variable length decoder unit 620 The get bit unit 
755 }s coupled to a pjogramrDable variable length encodeiydeooder 760. The 
5 programmable variable length encoder/decoder 760 is coupled to a memory buffer 
765. 

* 

In an embodiment, the get bit unit 755 comprises hardware that facilitates 
movement of digital video data from tho data streamer 705 to the programmable 

10. variable length encoder/decoder 760.. In an embodiment, the programmable variable 
length encoder/decoder 760 executes firmware instructions which decode the variable 
length symbols of the AC coofncfents of the digital video data. The variable length 
symbota are Huffman code symbols. In an ernbodiment» the variable length decoder 
unit 620 decodes the variable length code fomnat of a DOT block of digital video data 

15 at a time. Moreover, the programmable variable length encoder/decoder 760 controls 
fK3W the digital video data is transferred by the data streamer 705 and by the get bit 
unit 755 during the variable length decoding process. The memoiy buffer 765 stores 
DOT blocks of digital video data that have t>een decoded by the programmable 
variable length encoder/decoder 760. 

20 

The data streamer 705 transfers the digital vfdeo data from the memory buffer 
765 to a decoded data buffer 770 of a decompression unit 630 of the VLIW processor 

■ 

61 0. T?ie decoded data buffer 770 is coupled to a IDCT & IQ unit 775 of the VLIW 

-27- 
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processor 610- Tha IDCT & IQ unit 775 of the VLIW processor is coupled to the data 
stroamor 705. A do-shuffling unit 780 is coupled to the data strasimer 705. 

The proparaer unit 540 and the decompression unit 630 can be executed on the 
5 $amo VLiW processor 610, In an embodiment, the preparser unit 640 and the 
dec(m)prdssion unit 630 may run or execute according to time share criteria. For 
example, the preparser unit 640 and the decompression unit 630 can run on the VLIW 
processor 61 0 according to a fixed schedule. For instance, the VLIW processor 61 0 
executes Instructions In the preparser unit 630 for a first fixed amount ot time and thai 

10 switches to executing instructions In the decompression unit 640 for a second fixed 
amount of tlme^ In an alternate embodiment, the decompression unit 630 and the 
preparser unit 630 can be controlted by an interrupt procedure. For example, when 
there is a OCT block in the decoded data buffer 770, an interrupt is activated and 
causee the VLIW processor 610 to stop executing instructions In the preparser unit 630 

16 and to start executing instructions In the decompression unit 630 for a particular 
amount of time. 

In an embodiment, the decoded data buffer 770 stores a macro blocic (or six 
DOT blocks) of digital video data that has been decoded by the variable length 
20 decoder unh 620. In particular, the decoded data buffer 770 stores the DC coefficients 
(compressed) and the AC coefficients (compressed) necessary for the Inverse discrete 
cosine transform (IDCT). In an embodiment, the IDCT & iQ unit 775 of the VLIW 
processor 610 executes software instructions which decompress the distal video data 

-2d> 
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by performing the inverse quantization (IQ) on a macro block of digital video data at a 
time. Moreover, the IDCT & IQ unit 775 of the VLIW processor 61 0 executes software 
inetructione which decomprees the dtgilat video data by performing the inverse 
discrete cosine transform (IDCT) on a macro biock of digital vfdeo data at a tfme.r The 
5 de-shufflkig unit 780 can determine the con-ect macro block posrtion for each macro 
block on the frame of digital video data by using a macro bk>ck Index. 

The data streamer 705 transfers the djgftal video data from JDCT & IQ unFt 
775 of the VLIW processor 610 to the frarr« buffer B70 from which a frame of the digital 
10 video data can be readily displayed on an eieclronk: display devk;e 120 (Figure 1A)- 
The data streamer 705 is controlled by the de-shuffllng unit 780 to ensuie the macro 
bkxd<s are transferred to the correct macro bfock posftfon on the frame of the dfgftal 
video data, which Is analogous to putting together a jigsaw puzzle. It should be 
understood that MPEG formatted data does not require de-shuffllng.. 

15 

Figure 8 Illustrates a recovered data buffer 750 of Figure 7 in accordance with an 
embodiment of the present Invention. As Dlustrated In Rgure 8, the recovered data buffer 
750 includes a first recovered data buffer 605 and a second recovered data t>uffer 810. 
In an embodiment, the first recovered data buffer 805 and the second recovered data 
20 buffer 810 are each configured to store a segment of digital video data. TT>fs 

implementation facilitates concunrent execution of preparsing of the digital video data by 
the prepareer unK 640 and decoding of the digital vkleo data by the variable length 
decoder unit 620 . It should be understood that the recovered data buffer 760 can include 

-29^ 
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moro than two recovered data buffers. The number of recovered data buffers depends 
on the performance of the data streamer and available memory resourcos. 

For example, the preparser unit 640 preparses a first segment of dfgftai video data. 
5 The first segment of digital video data which has boon preparsed is stored in the second 
recovered dala buffer 810, While the preparser unit 640 preparses a second segment of 
digital video data and fllle the first recovered data buffer 805 with the second segment of 
digital video data, the variable length decoder unit 620 decodes the first segment of 
digital video data which has been preparsed by emptying the second recovered data 
10 buffer 810, 

Figure d iilustrates a decoded data buffer 770 of Figure 7 In accoirlance with an 
embodiment of the present invention. As illustrated in Figure 9» the decoded data buffer 
770 includes a first decoded data buffer 905 and a second decoded data buffer 910. in 
15 an embodirhent, the first decoded data buffer 905 and the second decoded data buffer 

■ 

910 are each configured to store a macro block of digital video data. This 
implementation facilRatee concurrent execution of decoding of the digital video data by 

9 

variable length decoder unit 620 and decompressing of the digital video data by the 
decompression unit 630. It should be understood thai the decoded data buffer 770 can 
20 include moro than two decoded data buffers. The number of decoded data buffers 
depends on the performance of the data streamer and avaDable memory resources. 
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For exampla. the variable length decoder unit 620 decodes a first macro block 
of digital video data, by dercoding a DOT block at a time. Tho first macro block of digital 
video data whteh has been decoded Fs stored in the second decoded data buffer 910, 
whereas tho data streamer 705 transfers the first n^cro block of digital video data to 
5 the second decoded data buffer 91 0. While the docompt^sskjn unit 630 

decompresses the first macro block of digital video data, which has been decoded, by 
emptying the eecond decoded data buffer 910. the variable length decoder unit 620 
decodes a second macro block of digital video data (by decoding a OCT block at a 
time) and the data streamer 705 fills the first decoded data buffer 805. IVIoroover. the 
1 0 decompression unit 630 de^huff les the first macro block. 

The foregoing descnptions of specific embodiments of tfie present Invention 
have been presented for purposes of illustration and description.. They ore not 
intended to be exhaustive or to limit the invontfon to the precise forme disclosed, and 

15 obviously many modifioatione and variations are pos&it>le in Bght of the above 

teaching. Tho embodiments were chosen and described in order to best explain the 
principles of tho invention and its practical application, to thereby enable others skilled 
in the art to best utilize the invention and various embodiments with various 
modifications as are suited to the particular use contemplated. It is intended that the 

20 scope of the invention bo defined by the Qlalm$ appended hereto and their 
equivalents.. 
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What is Clainied is: 

1 , A method of processing digital video data ibi diaplayii^ said mofl)od 
compttsing the steps of: 

a) prepaising said digital video data to recover a decoding order ol said 
digital video da^ and 

b) decoding a vflxiable length coding fotmat of said digital video data. 

2: Hie method of Claim 1, fiuthei comprising the steps of: 

c) moving said digital video data that has been processed by said step b); 

d) decompressing said digital video data to facilitate displaying said digital 
video data on on electronic display device. 

3 . A method as recited in Claim 1 oi 2, iliutbet comprising the stq>s oi: 
accessing a fitst plurality of said digital video data that has been processed by said 
step a); and 

p^fonning said step a) on a second plurality of said digital video data while said 
stop b) is perfonned on s^d first plurality oi said digital video data 

4- A method as icdtcd in Claim 2, leather compiistng the steps of: 

accessing a fii st portion of said digital video data that has been processed by said 

step b) and that has been pnx:essed by said step c); and 

32 
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perfonning said step b) on a second portion of said (Hgita3 video data while said 
step d) is petfoimod on said first portion oi said digital video data. 

5 . A method as i ecitcd in Claim 1 oj 2, wiicretn said step a) and said step d) aie 
poifbnned by a veiy long instruction wctrd (VLIW) processor. 

6.. A method as recited in Claim 4, whcixdn said step b) is performed by a vaxiable 
length decoding unit, and wherein said step a) and said step d) are perlbrmed according 
to time sharing ciitexia. 

7. A method as tedted tn Claim t or 2, further compiisitiK do-shuflQiDg said digital 
video data to a frame of said digital video data. 

8. A method as red ted in Claim I or 2, wherein said variable length coding format 
compxiees aHuffinan code fotmat. 

9. - A method as recited in Claim 1 oi 2, wherein said digital video data compnst^ 
DV fotmoued data. 

10. A mefltod as rocited in Claim 1, wherein said digital video data cocoiprises MPBG 
fomiatted data. 

1 1 The method of any one of Claims 1 through 1 0, wbexein said method is pet^med 
in a computer-readable medium comptising cQmputer-executublc instiuctions for 
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peifonumg said method . 

12. Aa appatatus fbr pioce^slng digital video data for dtsplaying, said ^'^patatu^ 
compxisin^ 

a processor configured to preparsc said digital video data to recover a decoding 
onlcn of said digital video datsi; and 

a vBiiable length decoding unit coupled to said processGi^ whet era smd variables 
iength decoding imit is configared to decode a vaiiable length coding fonnat ol'said 
digital video data. 

13. The {^paxatQs of Claim 12, wlxer^ said processor is coupled to said first 
memoiy bu£fex $aid decoder faziher comprising a second memoiy buffer coii^led to said 
processoi' and configured to store said digital video data aitei said digital video data is 
processed by said processor and said variable lengtli decoding unit. 

14. A digital video data decodcz its lecited in Claim 12 or 13^ whepoio said variable 
length decoding unit accesses a first plurality of said digital video data that has been 
ptocessecl by said processoi; and whiensin said processor prepaises a second pluxality of said 
digital video data Wbilc said variable length decoding unit decodes said Jixst plurality of said 
digital video data. 

15 A digital video data decoder as recitod in Claim 12 ot 1 3^ wherein said processor 
is fUiiher configured to decompress s»id digital video data to J^Htate displaying said 
digital video data on an electronic display device after said vaiiable length decoding 

34 
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limit decodes said digital video data. 

16. An appaiatus as recited m Claim 14, ittiTther comptising a direct memory access 
(DMA) mil coupled to said processor aad oo upled Co said variable length decodxag axut> 
wharein md DMA mit is oonfagiired to transfer said digital video data betv^ccn said 
processor and said vaiiable length decoding onit, and whei-eln said processoi accesses a 
fitst portion of said digital video data that has been piocesscd by said variable length 
decoding unit, and wherein said variable length decoding unit decodes a second poition 
of said digital video data while said piocessor decompresses said ili^t pottion of said 
digital video data. 

17. An apparatus as recited in Claim 1 2, wbei ein said pioceasor de-abuflled said 
digital video data to form a .frame of said digital video data after dccanapressing said 
digital video data. 

18. An appaiatus as recited in Claim 12, wbetein said pnocessot includes a jQrst 
recovered data bilker for storing said digital video data aftax* said processor prepaxses 
said digital video data. 

4 

19 An apparatus as recited in Claim 18, wherem said processoi* includes a second 
recovered data buffer for stoiing said digital video data after said pn>cessor prepaises 
said digital video data» and whereim one of said fixst and second recovered data buJOCers 
is filled with said digital video data pxi^arsed by said processor while one of said first 
and secoind recovered data buffers is emptied as said digital video data is decoded by 
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said vmiablo length decoding unit. 

20. An appaxatus as l edted in Claim 12» wJiGrein said processor includes a iiist 
decoded data bnlTei for stoting said digital video data after said variable length decoding 
unit decodes said digital video data. 

21. An appaiatns as lecited in Claim 20, wherein said processot' includes a second 
decoded data buifet for storing said digital video data after said variable length decoding 
uziit decodes said digital video data> and whcroin one of said Bxst and second decoded data 
buffers is iitled with said digital video dala decoded by said variable length decoding unit 
while one of said first and second decoding data bnffexs is emptied as said digital video 
data is decompressed by said luocessoi.. 

22- An appaiatns as recited in Claim 1 2 or 13» wherein said processor comprises a 
vety long instruction woTd (VUW) processor. 

23. An apparatus as recited in Claim 12 ot IS, wherein said variable length coding 
fbnnat compiises a Huffioukn code format 

24. An apparatus as recited in Claim 12 or 13, wherein said digital video data compiises 
D V fbimatted data. 

25. A digital video data decoder hs recited in Claim 15» wherein saidprocessoi iiccesses 
a first poidon of said digital video data that has been processed by said vatiablc length 

36 
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decoding unit, and wherdn said vmiable length decoding unit decodes a secand 
pordon oi said digital video data while said processor decompresses said iEirst pottion 
of'said digital video data. 



26 . A digital video data decoder as recited in Claim 13, wherein said ptocessoi 
de^shuifles said digital video data to form a frame of said digital video data after 
decompressing said digital video data, and wherein said fiame of said digital video 
data is stored in said second memof y buffer. 
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